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THE  BEST  m-TERM  APPROXIMATION  AND  GREEDY  ALGORITHMS1 


V.N.  Temlyakov 

Department  of  Mathematics,  University  of  South  Carolina,  Columbia,  SC  29208 

Abstract.  Two  theorems  on  nonlinear  ra-term  approximation  in  Lv  ,  1  <  p  <  oo, 
are  proved  in  this  paper.  The  first  one  (Theorem  2.1)  says  that  if  a  basis  :=  {p/}/ 
is  Lp-equivalent  to  the  Haar  basis  then  near  best  m-term  approximation  to  any 
/  £  Lp  can  be  realized  by  the  following  simple  greedy  type  algorithm.  Take  the 
expansion  /  =  c/p/  and  form  a  sum  of  m  terms  with  the  biggest  ||cji/jj||j,  out  of 
this  expansion. 

The  second  one  (Theorem  3.3)  states  that  nonlinear  m- term  approximations  with 
regard  to  two  dictionaries:  the  Haar  basis  and  the  set  of  all  characteristic  functions 
of  intervals  are  equivalent  in  a  very  strong  sense. 


1.  Introduction 

This  paper  deals  with  nonlinear  approximation  in  Banach  spaces.  Let  B  be  a 
separable  Banach  space  and  T>  be  a  system  of  elements  in  B  such  that  spamD  =  B. 
Consider  the  best  m- term  approximation  of  an  element  /  E  B  with  regard  to  the 
given  system  (dictionary)  'D 


am(f,V)B  ■=  inf  ||/ -  ^CjgjWB  ,m  =  1,2,...,  a0(f,  V)B  :=  ||/||B  , 

3  = 1 

where  inf  is  taken  over  elements  gj  E  V  and  coefficients  Cj,j  =  1  The 

quantity  crm(f,  T>)b  gives  the  best  possible  error  of  approximation  of  /  by  a  linear 
combination  of  m  elements  from  the  given  dictionary  T>.  The  fundamental  question 
in  this  study  is  how  to  construct  an  algorithm  which  provides  an  error  of  approx¬ 
imation  of  /  comparable  with  am(f ,V)b ■  The  answer  to  this  question  in  some 
particular  cases  is  simple.  For  instance  if  B  =  H  is  a  Hilbert  space,  and  V  is  an 
orthonormal  basis  then  the  Pure  Greedy  Algorithm  which  picks  the  m  biggest  in 
absolute  value  Fourier  coefficients  of  /  with  regard  to  V  realizes  the  best  m- term 
approximation.  In  the  paper  [Tl]  we  studied  the  performance  of  Pure  Greedy  Al¬ 
gorithm  with  regard  to  the  trigonometric  system  T  :=  )n  the  Banach 

spaces  Lp( Td),  1  <  p  <  oo.  We  proved  there  the  inequality  for  approximation  of 
individual  function 

11/  -  Gm(f,  T)  Up  <  (1  +  3 mhW)am(f,  T)p  ,  1  <  p  <  oo, 

where  h(p)  :=  1 1/2  —  l/p|.  This  inequality  is  sharp  (in  the  sense  of  order)  and  can 
be  extended  to  other  orthonormal  uniformly  bounded  bases.  We  note  here  that  the 

1This  research  was  supported  by  the  National  Science  Foundation  Grant  DMS  9622925  and 
by  ONR  Grant  N00014-96-1-1003 
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use  of  Pure  Greedy  Algorithm  Gm  for  approximation  in  Lp  seems  reasonable  in  the 
case  of  uniformly  bounded  basis  {<f> j}  because  in  this  case  we  have 

1/M  <  1 1 (fj 1 1 r  <  ll^-llp  <  Halloo  <  M. 

This  means  that  Lp-norm  of  each  summand  is  of  order  of  \(f,<f>j)\- 

In  this  paper  we  consider  another  important  class  of  bases.  A  typical  represen¬ 
tative  of  this  class  is  the  Haar  basis  'H  :=  where  /  are  dyadic  intervals  of 

the  form  I  =  [(j  —  l)2~n,j‘2~n),  j  =  1, . . .  ,2 n;u  =  0, 1, . . .  and  I  =  [0, 1]  with 

H[o,i]{x)  =  1  for  x  E  [0,1)  , 

f  2n/2,  x  £  [(j  —  l)2-n,  (j  —  l/2)2_n) 

H[(j- i)2-,i2-»)  =  <  -2"/2,  *  G  [(j  ~  1/2)2"",  j2"») 

^  0,  otherwise. 

For  the  Haar  basis  we  define  for  each  1  <  p  <  oc  the  Greedy  Algorithm  Gp 
which  acts  as  follows.  Denote 

cI(f):={f,HI)=  [  f(x)HI(x)dx  , 
do 

and 

c/(/,p)  :=  \\cI(f)HI\\p  . 

Let  A  be  a  set  of  m  dyadic  intervals  I  for  which  c/(/,p)  take  the  biggest  values. 
We  set 

GpJf,n)~Y.c’^H'  ■ 

I£  A 

Remark  1.1.  There  is  an  algorithm,  which  for  any  /  G  Lp  gives  an  I  with  the 
biggest  \\cj(f)Hj\\p  after  finite  number  of  steps  provided  we  can  calculate  each  cj(f) 
and  the  Lp-norm  of  a  function  in  finite  number  of  steps. 

We  describe  this  algorithm  now.  Let  /  0.  We  find  a  nonzero  coefficient  cj(f) 

and  denote  e  :=  |cj(/)|.  Next,  we  find  n  such  that 

II/-  £  ||p<£. 

1 1\  >’2  '• 

This  guarantees  that  for  all  |I|  <  2~n  we  have  \\ci(f)Hi\\p  <  e  and,  therefore,  we 
can  restrict  our  search  for  the  biggest  ||c/(/)R/||p  to  the  finite  number  of  I  with 
\I\>2~n. 

In  Section  2  we  prove  that  for  any  1  <  p  <  oo  we  have  for  /  G  Lp 

\\f  -Gpm(f,n)\\p<c(p)am(f,n)p  . 

This  means  that  the  Greedy  Algorithm  Gf^  realizes  near  best  m- term  approxima¬ 
tion.  We  also  prove  that  the  same  inequality  holds  for  bases  equivalent  to  the  Haar 
basis. 
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In  Section  3  we  study  the  following  general  problem  in  one  special  case.  Assume 
we  have  two  dictionaries  T>\  and  V 2  in  B  and  want  to  compare  their  efficiency  for  m- 
term  approximation.  Let  us  introduce  the  following  quasinorm  in  B  for  0  <  a  <  00 
and  0  <  (3  <  00 


\f;a,f3,V,B\  :=  (||/||'3  +  ^(2“”CT2.,(/,P)B)'3)1/'3. 

n= 0 


We  call  two  dictionaries  T>i  and  V 2  (a,  (3)- equivalent  if  for  any  f  E  B  the  quasinorms 
|/;  a,  /3,  T>i ,  B\  and  |/;  a,/3,  D2,  B\  are  equivalent.  In  particular,  (a,  00) -equivalence 
means  that 


crm(/,  L>i  )b  -C  m  Q 


if  and  only  if 

<  m~a. 

We  discuss  in  Section  3  one  concrete  pair  of  dictionaries:  V 1  =  %  :=  {|«7|_1//2X  j,  «/  C 
[0, 1]}  -  the  set  of  all  characteristic  functions  of  intervals  (normalized  in  ) :  and 
I?2  =  'H  -  the  Haar  basis.  It  is  clear  that 


(1.1) 


j  3~L )  p  >  <^2  m(fiX)p- 


We  prove  that  these  two  dictionaries  are  (a,  /3)-equivalent  for  any  a  and  (3. 

We  note  that  <7m(f,x)p  is  closely  related  to  approximation  by  splines  with  free 
knots.  This  is  based  on  the  following  simple  remark. 


Remark  1.2.  For  any  set  of  intervals  in  [0,1]  there  exists  a  set  of 

disjoint  intervals  Jjj . . .  ,  U 2j=i~1  =  [0)  1] ,  such  that  any  function  f  of  the 

form 

m 

f  =  CiXj‘ 

i—  1 

can  be  rewritten  in  the  form 

2m+l 

f  =  bixJf- 

3= 1 


The  proof  of  this  remark  can  be  carried  over  by  induction  on  m. 

Combining  known  results  about  approximation  by  splines  with  free  knots  (see 
[DL],  Ch.  12,  s.  8,  p.  388)  and  known  results  on  m- term  Haar  approximation 
and  using  Remark  1.2  we  get  that  the  dictionaries  y  and  3~L  are  (a,  (a  +  1/p)-1)- 
equi valent,  0  <  a  <  1. 


2.  Greedy  Algorithms  for  bases  equivalent  to  the  Haar  basis 

Let  tk  :=  be  a  basis  in  Lp[ 0, 1]  indexed  by  dyadic  intervals  /.  We  say  that 

is  Lp-equivalent  to  B  if  there  exist  two  positive  constants  C-\  (p)  and  Cz(p)  such 
that  for  any  finite  set  of  coefficients  cj  we  have 

Cl (p) II II,  £  llEc*ll,  £  c2(p)|iE^ff/ll,- 

II  I 


(2.1) 
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One  can  find  a  discussion  and  some  results  about  bases  Lp-equivalent  to  %  in  the 
paper  [DKT]. 

For  a  given  basis  we  define  the  Greedy  Algorithm  Gp(-,  \&)  as  follows.  Let 

i 

and 

ci(f,P,V)  '■=  \\ci(f^)i’i\\p- 

Then  c/(/,p,  0  as  |/|  — »  0.  Denote  Am  a  set  of  m  dyadic  intervals  I  such  that 

(2.2)  min  cj(/,p,tf)  >  max  cj(f,p,V). 

I 0  A  J<?  A, „ 

We  define  Gp (•.  T)  by  formula 

Grm (/,¥):=  Y  m,, 

I£  A,„ 

Theorem  2.1.  Let  1  <  p  <  oo  and  a  6as?'s  ;=  {-(/)/}/  be  Lp-equivalent  to  Lt. 
Then  for  any  f  G  Lp  we  have 

Proof.  Let  us  take  a  parameter  0  <  t  <  1  and  consider  the  following  greedy  type 
algorithm  Gp,t  with  regard  to  the  Haar  system.  Denote  A m(t)  any  set  of  m  dyadic 
intervals  such  that 

(2.3)  min  c7(/,p)  >  t  max  cj(/,p), 
and  define 

<?£*(/):=  E  CA!)H,. 

l£Am(t) 

For  a  given  function  /  G  Lp  we  define 

ad) 

i 

It  is  clear  that  g(f)  G  Lp  and 

(2.4)  Pm(g(f),'H)P  <  C1(p)~1am(f,^)p. 

Next,  for  any  two  intervals  I  G  Am,  J  ^  Am  by  the  definition  of  Am  we  have 

c/(/,P,^)  >  cj(/,p,*). 

LTsing  (2.1)  we  get  from  here 

(2.5)  ||c/(p(/))ffi||p  =  ||c/(/,^)i?/||p  >  C’2(p)-1||c/(/,^)'0/||p  = 

=  C2(p)~1cI(f,p^)  >  C2(p)-1cj(/,p,4>)  = 

=  C2(p)-1||cj(/,^)'0j||p  >  C\  {p)C2(p)~1  ||cj(p(/))i?j||p. 

This  inequality  implies  that  for  any  m  we  can  find  a  set  A m(t),  where  t  =  Ci(p)C2(p)~ 1 
such  that  A m(t)  =  Am  and,  therefore, 

(2.6)  ||/  -  G*  (/,*)||p  <  C2(p)\\g(f)  -  GpJ(g(f))\\p. 

The  relations  (2.4)  and  (2.6)  show  that  Theorem  2.1  will  follow  from  Theorem  2.2. 
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Theorem  2.2.  Let  1  <  p  <  oo  and  0  <  t  <  1.  Then  for  any  g  £  Lp  we  have 

h  ~  Gp^{g)\\p  <  C(p,t)am(g,n)p. 


Proof.  The  Littlewood-Paley  Theorem  for  the  Haar  system  (see  for  instance  [KS]) 
gives  for  1  <  p  <  oo 


(2.7) 

<vs<p)||<27  |c7(sr)mi2)I/2l|P  <  llall,,  <  c-4 

I 

I 

We  formulate  first  two  simple  corollaries  from  (2.7) 

(2,8) 

ll*<c5(p)(Ellci(9)i?ill?)1/’S 

I 

1  <p  <  2, 

(2.9) 

IMIp  <  cg(p)(Y1  IM^/llp)172! 

I 

2  <  p  <  oo. 

Analogs  of  these  inequalities  for  the  trigonometric  system  are  known  (see,  for  in¬ 
stance,  [T2],  p.  37).  The  same  proof  gives  (2.8)  and  (2.9). 

The  dual  inequalities  to  (2.8)  and  (2.9)  are 

(2,10) 

ll9llP>C7(ri(£|M9)tf,||5)1/2, 

I 

1  <p  <  2, 

(2.11) 

ll*>C8(p)(^||cJ(p)ffJpI/P> 

2  <  p  <  oo. 

i 


We  proceed  to  the  proof  of  Theorem  2.2.  Let  Tm  be  an  m- term  Haar  polynomial 
of  best  m-term  approximation  to  g  in  Lp  (for  existence  see  [D]): 

Tm  =  ^2  aiHh  | A |  =  m. 

I£  A 

For  any  finite  set  Q  of  dyadic  intervals  we  denote  by  Sq  the  projector 

IGQ 


From  (2.7)  we  get 

(2.12)  \\g  -  Sa(0)||p  =  \\9  -Tm-  SA(g  -  Tm) \\p  <  \\Id  -  SA\\p^pam(g,'H)p  < 

C4(p)C3{p)~1am{g,'H)P , 
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where  Id  denotes  the  identical  operator.  Further,  we  have 

Gft‘0)  =  Sa„(.)(s), 

and 

(2.13)  Ilfi,  -  G%(g)\\,  <  Il9  -  Sa(s)IIp  +  ||SA(9)  -  5a„.(1)(9)IIp. 

The  first  term  in  the  right  side  of  (2.13)  has  been  estimated  in  (2.12).  We  estimate 
now  the  second  term.  We  represent  it  in  the  form 

S\{g)  -  S\m(t)(g )  =  SA\Am(t){g)  -  sAm{t)\A(g) 

and  remark  that  similarly  to  (2.12)  we  get 

(2.14)  ll'-hv,m(t)\A (g) Up  <  C9(p)am(g,n)p. 

The  key  point  of  the  proof  of  Theorem  2.2  is  the  estimate 

(2.15)  I|Sa\a„(,)0)IIp  <  C(p,t)||SJm(t)\A(9)llp 

which  will  be  derived  from  the  following  two  lemmas. 

Lemma  2.1.  Consider 

f=Y,ciHn  \Q\  =  N. 

IGQ 

Let  1  <  p  <  oo.  Assume 

(2.16)  WciH^p  <  1,  IeQ. 

Then 

\\f\\p<C10(p)N1/p. 


Lemma  2.2.  Consider 


Let  1  <  p  <  oo.  Assume 
Then 


f  =  YJCiHI ,  \Q\  =  N. 

IGQ 

Hc/^/||p  >  l)  IeQ. 

II/IIp>Cii(p)JV1/ij. 


Proof  of  Lemma  2.1.  We  note  that  in  the  case  1  <  p  <  2  the  statement  of  Lemma 
2.1  follows  from  (2.8).  We  will  give  a  proof  of  this  lemma  for  all  1  <  p  <  oo.  We 
have 

\\cIHI\\p  =  \cI\\I\1lp-1l2. 

The  assumption  (2.16)  implies 


M  <  |/|  1/2-1/p. 


Next,  we  have 
(2.17) 


P  — 


E  ^  ii  E  i7i_1/A/( 

IGQ  IGQ 

where  Xi(x)  is  a  characteristic  function  of  the  interval  I 

L  x  El 
0,  x  ^  I. 

In  order  to  proceed  further  we  need  a  lemma. 


x 


ip? 


Xiix)  = 
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Lemma  2.3.  Let  n\  <  <  •  •  •  <  ns  be  integers  and  let  Ej  C  [0, 1]  be  measurable 

sets,  j  =  1 , ,s.  Then  for  any  0  <  q  <  oo  we  have 


S 


('Z^nilqXE1  (x))qdx  <  C12(<j)  V  2”i  \Ej 

3  =  1  3  =  1 


Proof.  Denote 


and  estimate  it  on  the  sets 


F(x):=J22’‘,/,XE1(x) 

3= 1 


Et  :=  Ei  \  Usk=l+1Ek,  /  -  I . .s'  I;  Es  :=  Es 

We  have  for  .r  G 

z 

F(X)<Y.2n,h  <  C(q)2n,/q . 

3=1 

Therefore, 


l 


F(.T)gd.T  <  C(?)9^2n'|E- 

Z=1 


<<?(</)«  £>'1^ 
z=i 


what  proves  the  lemma. 

We  return  to  the  proof  of  Lemma  2.1.  Denote  by  n-\  <  ?r2  <  •  •  •  <  ns  all  integers 
such  that  there  is  I  G  Q  with  \I\  =  2~nj .  Introduce  the  sets 


Ej  ■—  u/eQ;|/|=2_'li  E 

Then  the  number  N  of  elements  in  Q  can  be  written  in  the  form 

S 

(2.18)  N  =  ^2\Ej\2nL 

3  =  1 

Using  these  notations  the  right  hand  side  of  (2.17)  can  be  rewritten  as 

Y:=(  f  CE^'-xEAnrax)1/*. 

Jo  j=1 


Applying  Lemma  2.3  with  q  =  p  we  get 

S 

11/11*  <  Y  <  c13(p)(E  =  C,3(p)N'!p. 

3  =  1 

On  the  last  step  we  used  (2.18).  Lemma  2.1  is  proved  now. 
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Proof  of  Lemma  2.2.  We  derive  Lemma  2.2  from  Lemma  2.1.  Define 

IGQ 

where  the  bar  means  complex  conjugate  number.  Then  for  p'  =  we  have 

iic/|c/riijr/p_i/2ff/iip'  =  i 


and  by  Lemma  2.1 

(2.19)  |M|p'  <  C1o(p)N1^p' . 

Consider  (f,u).  We  have  on  one  hand 

(2.20)  U.u)  =  Y,  MlY/p_1/2  =  Y  llc'ff'llp  >  AT, 

IGQ  IGQ 


on  the  other  hand 


(2-21)  (f.  v)  <  \\f\\P\\u\\p.. 

Combining  (2.19)  -  (2.21)  we  get  the  statement  of  Lemma  2.2. 

We  complete  now  the  proof  of  Theorem  2.2.  It  remained  to  prove  the  inequality 
(2.15).  Denote 

4  :=  r  I1™*  \\ci(9)Hi\\Pi 

IG  A\Am(t) 


and 


B  :=  min 

lGAm(t)\A 


ci{g)Hi\\p. 


Then  by  the  definition  of  A m(t)  we  have 

(2.22)  B  >  tA. 


Using  Lemma  2.1  we  get 

(2.23)  ||Sa\A,„W(<?)||p  <  AC10(p) |A  \  Am(t)|1^  <  W15C10(p) |A  \  A m(t)\1/p. 
Using  Lemma  2.2  we  get 

(2.24)  l|SA.,.(t)XA(9)l|P  >  BC„(p)|Am(<)\  AP». 

Taking  into  account  that  |Am(t)  \  A|  =  |A  \  Am(t)|  we  get  from  (2.23)  and  (2.24) 
the  relation  (2.15). 

The  proof  of  Theorem  2.2  is  complete  now. 

We  discuss  now  the  multivariate  analog  of  Theorem  2.1.  There  are  several  natural 
generalizations  of  the  Haar  system  to  the  d-dimentional  case.  We  describe  here  that 
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one  for  which  the  statement  of  Theorem  2.1  and  its  proof  coincide  with  the  one¬ 
dimensional  version.  First  of  all  we  include  in  the  system  the  constant  function 

H[o,i]d(x)  =  1,  x  G  [0,  l)d. 

Next  we  define  2d  —  1  functions  with  support  [0,  l)d.  Take  any  combination  of 
intervals  Q i, . . .  ,  Qd  where  Qi  =  [0, 1]  or  Qi  =  [0, 1)  with  at  least  one  Qj  =  [0, 1), 
and  define  for  Q  =  Q i  x  •  •  •  x  Qd,  x  =  (x\, . . .  ,  Xd), 

d 

Hq(x):=  Y[HQi(Xi). 

i—  1 

We  shall  also  denote  these  functions  by  H^Q  1y(x),  k  =  1, . . .  ,2d  —  1.  We  define 
the  basis  of  Haar  functions  with  supports  on  dyadic  cubes  of  the  form 

(2.25)  J  =  [(h  -  l)2-n,  j12-n)  x  •  •  •  x  [(jd  -  1)2"",  jd2~n), 

ji  =  l,---,2n;  n  =  0,1,...  . 

For  each  dyadic  cube  of  the  form  (2.25)  we  define  2d  —  1  basis  functions 

Hkj(x)  :=  2  nd/2H^iy  (2n(x  -  (n  -l  l)2~n)),  k  =  1, . . .  ,  2d  -  1. 

We  can  also  use  another  enumeration  of  these  functions.  Let  1jrf(®)  =  Hq(x) 
with 

Q  =  Qi  x  •  •  •  x  Qd,  Qi  =  [0, 1),  i  G  E,  Qi  =  [0, 1],  *  G  {M}\  E,  E  ^  0. 

Consider  a  dyadic  interval  I  of  the  form 

(2.26)  I  =  IlX---xId,  Ii  =  [(ji  —  l)2~n ,ji‘2~n),  i  e  E, 

Ii  =  [(ji  -  1)2-%  j;2-n],  ie{l,d}\E, 

and  define  Hj(x)  :=  x).  Denoting  the  set  of  dyadic  intervals  D  as  the  set  of 

all  dyadic  cubes  of  the  form  (2.26)  amended  by  the  cube  [0,  l]d  and  denoting  by  "H 
the  corresponding  basis  {FZ/}/€d  we  get  the  multivariate  Haar  system. 

Remark  2.1.  Theorem  2.1  holds  for  the  multivariate  Haar  system.  H  with  the 
constant  C(p)  allowed  to  depend  also  on  d. 

We  studied  in  this  section  approximation  in  Lp([ 0, 1])  and  made  a  remark  about 
approximation  in  Lp([0,  l]d).  We  can  treat  in  the  same  way  approximation  in 

Lp(M.d). 

Remark  2.2.  Theorem.  2.1  holds  for  approximation  in  Lp(Rd). 

Results  on  approximation  of  function  classes  using  multivariate  greedy  algorithm 
G^(-,d>)  can  be  found  in  [DJP], 
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3.  Comparison  of  two  dictionaries 

We  begin  this  section  by  one  result  about  approximation  of  functions  from 
Ari'H^Lp^A)  by  m- term  Haar  polynomials.  Let  0  <  r  <  oo;  we  denote  by 
At{TL ,  Lp ,  .4)  the  set  of  functions  /  €  Lp  such  that 

(3.1)  \f-,Ar(H,Lr)\  :=  (£  ||c/(/)ff,||;)1/’-  <  A. 

I 


It  seems  that  the  set  of  classes  Ar  ('H.  Lp,  A)  is  a  natural  replacement  for  standard 
Holder,  Sobolev  or  Besov  smoothness  classes  when  we  study  nonlinear  m- term  ap¬ 
proximation  instead  of  linear  approximation.  This  opinion  is  based  on  the  following 
two  arguments.  1).  The  terms  cjiJ/  have  the  same  weight  in  the  definition  of  the 
class  AT{l-L^Lp^A)  for  all  I.  2).  There  are  some  results  which  describe  the  classes 
of  functions  with  a  given  decay  of  their  best  m- term  approximation  in  terms  of  AT 
classes.  We  illustrate  this  statement  by  a  particular  case  of  one  well-known  result 
of  Stechkin  (see  for  instance  [DT]).  We  have  the  equivalence 


£( 

m=  0 


Vmifi'H)  2 

( m  +  l)1/2 


)T  <  oo  <s>  |/;  At(TL,  L2)\  <  oo. 


Further  results  in  this  direction  could  be  found  in  [DJP],  In  particular,  the  following 
Theorem  3.1  can  be  derived  from  Theorem  2.1  in  [DJP],  We  give  here  another  proof 
of  Theorem  3.1. 

Theorem  3.1.  Let  0  <  r  <  p  <  oo  be  given.  There  exists  C(r,p )  such  that  for 
any  m  €  1  !  we  have 

am(f ,  H)p  <  C(T,p)m1/p-1/T\f]Ar('H,Lp)\. 


Proof.  We  start  with  the  case  p  <  1  (under  the  assumption  r  <  1).  In  this  case 
||  •  ||p  is  a  quasinorm.  We  use  the  G ^  algorithm  defined  in  Section  1.  Then 

(3.2)  ii/-g*(/,w)ii?=  /  \  Y,‘='(jmpdx<Y,\Mm,rP- 

I<£  A  JgA 

We  use  now  the  following  simple  and  well-known  lemma  (see  for  instance  [T2], 
P-97). 

Lemma  3.1.  Let  yi  >  1/2  >  •  •  •  >  0  and  for  som.e  r  >  0 

OO 

k=  1 


OO 

(Yl  yk)llP  ^  -4m1/p_1/r. 

k=  m 


Then  for  any  p  >  r  we  have 
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Using  this  lemma  with  yj  :=  \\cj.  (f)Hj.\\p,  where 

\\Ch(f)Hh\\p  >  llC/2(/)#/2||p  >  •  •  • 

we  get  from  (3.2)  the  required  estimate. 

In  the  case  1  <  p  <  2  we  use  the  above  arguments  with  (3.2)  replaced  in  accor¬ 
dance  with  (2.8)  by 

(3.3)  11/  -  G*  (/,*) II,  <  I M/)ff/!P1/p. 

1$  A 

Let  us  proceed  to  the  remaining  case  2  <  p  <  oo.  Our  proof  in  this  case  will  use 
Lemma  2.1.  We  keep  the  above  notation  yj,  j  =  1,2, ...  .  Then  we  have 


(3.4) 


-4:=|/;A(W.Ip)|  =  (^!/J)1/t. 

3  =  1 


In  particular,  this  implies 
(3.5) 


Vm  — 


<  Am  1//r. 


Denote  mo  :=  m  and  denote  by  m/,  l  =  1,  2, . . .  ,  the  index  such  that 

Vmi  A  Vm  2  i  Umi  +  l  A  ?/m2 

Then  for  m/_i  <  k  <  mi  we  have 
(3.6)  ym2~l  <yk  <  ym2~l+1 . 

Define  TV/  :=  m/  —  m/_i.  The  relations  (3.4)  and  (3.6)  imply 


^(^2-^TV/  <  W 


z=i 


(3,7) 

Further,  we  have 


(3.8)  S  :=  \\f  -  GUf,H)\\r  =  \\  Y. 

j=m- 1-1  1=1 


where  we  have  denoted 


By  Lemma  2.1  we  get 


mi 


h  -  E  ch(f)nh- 

j=mt- i  +  l 

||//||p<?/?n2-/+1C1o(p)TV;/p. 
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From  here  and  (3.8)  we  obtain 


(3.9)  5  <  2 C10(p)  ym2~lNl/p  =  2 C10(p)  Y((y^~l)r  < 

i=i  i=i 


<Ci(T,p)(Y,(y™2-‘)TN,)1/ry^T/r. 

1=1 

Using  (3. 7), (3. 5)  and  (3.4)  we  get  from  (3.9) 

5  <  C1(r,p)Am1/p~1/T  =  C1(T,p)m1/p~1/T\f]AT('H,Lp)\ , 

what  completes  the  proof  of  Theorem  3.1. 

We  proceed  now  to  studying  approximation  of  linear  combinations  of  characteris¬ 
tic  functions  by  m- term  Haar  polynomials.  We  introduce  some  notations  convenient 
for  us.  Denote  for  any  interval  J 


ih  ■=  \J\~1/2xj 

and  for  s  E  N 

S 

F(s,  x)  ■=  {f  ■  f  =  Y  btUj‘  ’  Ji  C  [O’  1]>  *  =  •  •  ’  5 }• 

i—  1 

Lemma  3.2.  For  any  0<r<l<p<oo  there  exists  C(r,p)  such  that  for 
f  E  F(s,  x)  we  have 


\f]Ar(n,Lp)\<C(r,P)s1^-1/p\\f\\p. 


Proof.  Consider  first  the  Fourier-Haar  expansion  of  Uj  for  some  J  C  [0, 1].  For 
each  level  k  of  Haar  functions  Hj ,  \I\  =  2~k,  at  most  two  functions  H/pj)  and 
)  will  have  nonzero  inner  product  with  Uj.  For  these  Il(J),i  =  1,2,  we  have 

(3.10) 

Thus  we  have  for  any  |$|  <  1/2  and  r  >  0 

(3.11)  E(Mp-i)i(i7i/iJi)'’)T<c(«,Tr. 


/  =  5>cy 

i—  1 


Consider  now 
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Using  Remark  1.2  we  represent  /  in  the  form 

23+1 

f  =  Yl  akU Jd  1 

k=  1 

with  disjoint  J-f . . . .  ,  J^+i-  Then 

(3-i2)  ii/ii'  =  e  bwJtwi  =  e 

k=  1  k=  1 

Take  any  0  <  r  <  1  and  estimate 

(3.i3)  EMi>i7'ii;  =  EM/>nT1/,,“1/2). 

/  / 

We  have 

M/)r  =  i  E  a^/(r+ir  <  E  kri+v+r. 

fc=l  fc=l 

From  here  and  (3.13)  we  get 

Em/wu  <  E  KrEM^)nE,/!-,/2)  = 

/  fc=i  / 

E(KH4T/!-1/2)rE(MUi)i(mr)1/’,'1/2)r^ 

*=i  J  I I 

Using  (3.11)  with  6  =  1/p  —  1/2  we  continue 

<c,(T.PrE(Mi+Jr/p“,/2r< 

k=i 

23+1 

C,(r.p)T(2«  +  E  (|ai||+d|1/l-1/2nT/'’  =  C1(t,pY(2s  +  1 ) 1  || / ||J , 

fc=l 

what  completes  the  proof  of  Lemma  3.2. 

We  use  Lemma  3.2  and  Theorem  3.1  to  prove  an  upper  estimate  for  <7m(f,  'H)p 
in  terms  of  an{f,x)P- 

Theorem  3.2.  For  any  1  <  p  <  oo  and  r  >  0  there  exist  positive  C,C(p),C(p,r) 
and  d(p)  such  that  for  any  n  =  1,2,...,  we  have 

n 

*C2»(f,n)p  <  C(p,r)^(72,(/,x)p2-^-fc)  +  C(p)||/||p2-^)2"/2. 

k= o 
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Proof.  Let  e  >  0  be  an  arbitrary  number  and  let  tk,k  =  0, 1,..,  ,n,  be  a  e-best 
2fc-term  approximation  of  /  with  regard  to  y  in  the  Lp-norm: 

11/  -  tk\\P  <  min {a2h  (/,  y)p  +  e,  ||/||p). 

We  represent  /  in  the  form 

(3.14)  f  =  f  ~  tn  +  tn  —  tn_ i  +  •  •  •  +  t\  —  to  +  to- 

We  have 

(3-15)  ||/  -tn \\p  <  (Tariff,  X)p  +  e| 

and 

(3.16)  \\tk  -  <  2a2k-i(f,x)P  +  2e  ,  fc=l,2,...,n. 

For  to  we  have 

(3.1T)  \\t0\\p<2\\f\\p. 

For  m  =  mo  +  mi  +  •  •  •  +  mn  we  get  from  the  representation  (3.14) 

n 

(3.18)  am(f,n)p  <  ||/ -  tn\\p  +  E  O m*.  (j'k  tk  —  1  ?  P)p  P  ®m0  (to,n)p. 

k= i 

We  choose  now  mk  :=  [2(n+fc)/2].  Then 

n 

m  =  mk  <  C2n. 
k= o 

Next, 

tk  —  tk-i  G  T(2fc  +  2fc  1,  y). 

Using  Lemma  3.2  and  Theorem  3.1  with  r  =  (2r  +  l/p)_1  we  get 

2  fc 

(3.19)  Omk{tk  -  tk-i,'H)p  <  C(r,p)(—)2r\\tk  -  tfc_i||p  < 

TYlk 

C(r,p)2-{n~k)(a2k-i(f,x)p  +  e). 

At  the  last  step  we  used  the  dehnition  of  m^  and  (3.16). 

Let  us  consider  now  (7mo  (t0, 'H)p.  We  estimate  first  cfu{Uj,'H)p.  LIsing  (3.10)  we 
get 

(3.20)  &4i{Uj,  V.)p  <  Y,  \\^(Uj)HI\\p+  Y  \\ci(uj)hi\\p< 

i/i<ij|2-'  m>|j|2« 

<  C(p)|J|l/p-l/22-fi1/2-|l/p-l/2|)_ 

Next,  to  =  aUj  and  by  (3-17) 

M  <2||/||p|J|1/2_1/’>. 

From  here  and  (3.20)  with  l  :=  [2 / 2 — 2 ]  and  0(p)  :=  (1/2  —  1 1/p  —  l/2|)/4  we  get 

(3.21)  <7m0(to,n)p<C(p)2-d^2n/2. 

Combining  (3.15),  (3.19)  and  (3.21)  we  complete  the  proof  of  Theorem  3.2. 
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Theorem  3.3.  For  any  a  >  0,  0  <  (3  <  oo  we  have  for  f  €  Lp 

Ci(a,p,p)\f;a,p,%Lp\  <  \f;a,p,n,Lp\  <  C2(a,p,p)\f;a,p,x,Lp\. 

Proof.  The  first  inequality  follows  from  Theorem  3.2  and  Lemma  3.4  and  the  second 
inequality  follows  from  (1.1)  . 

Lemma  3.4.  Let  two  sequences  {an'}^=1  and  {bk}(j*L1  of  nonnegative  numbers  sat¬ 
isfy  the  inequalities 


an<Ybk  2r(fc-n),  n  —  1,2,..,, 

k=  l 


with  some  r  >  0.  Then  for  any  0  <  a  <  r  and  0  <  p  <  oo  we  have 

OO  OO 

(^2(‘2ananY3)1/l3  <  C(a,P,r)(Y/(2akbk)l3)1/(3. 

n= 1  k= 1 


Proof.  Consider  first  the  case  0  <  p  <  1.  We  have 

n 

a?  <  ^  b>:1Mk-n) 

k= l 

and 

OO  OO  n 

Y(2 ananf  <  Y^a~r)0nYbk2^rk  = 

n= 1  n=  1  k=  1 

oo  oo  oo 

=  Y  bk2prk  2(Q_r)/?n  <  C(a,  r)  Y  &?2a/3fc. 

fc=l  n=k  k= 1 

Let  us  proceed  now  to  the  case  1  <  p  <  oo.  Take  6  :=  (r  —  a)/ 2  and  estimate  using 
the  Holder  inequality 

n 

an  <  C(0)(Y(bk2ir-d)ik-n))l3)1/l3 

k=  1 

Similarly  to  the  above  we  get  the  required  inequality. 

It  remains  to  consider  p  =  oo.  Let  bk  <  2~ak,  k  =  1,2, ...  ,  then 

n 

an  <  Y  2-ak+r^k-n^  <  C(r  -  a)2~an,  n  =  1,2,.... 

k=i 


This  completes  the  proof  of  Lemma  3.4  and  Theorem  3.3. 
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